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Abstract: We obtain invariance principles for a wide class of fractionally in- 
tegrated nonlinear processes. The limiting distributions are shown to be frac- 
tional Brownian motions. Under very mild conditions, we extend earlier ones 
on long memory linear processes to a more general setting. The invariance 
principles are applied to the popular R/S and KPSS tests. 



1. Introduction 

Invariance principles (or functional central limit theorems) play an important role 
in econometrics and statistics. For example, to obtain asymptotic distributions of 
unit-root test statistics, researchers have applied invariance principles of various 
forms; see [24 , 3(| 4(| among others. The primary goal of this paper is to establish 



invariance principles for a class of fractionally integrated nonlinear processes. Let 
the process 

(1.1) u t =F(...,e t - 1 ,e t ), t€Z, 

where s t arc independent and identically distributed (iid) random variables and F 
is a measurable function such that Ut is well-defined. Then ut is stationary and 
causal. Let d e (—1/2, 1/2) and define the Type I fractional 1(d) process X t by 

(1.2) (1 - B) d (X t - n) = u t , tez, 

where /j, is the mean and B is the backward shift operator: BX t = Xt-i- The 
Type II 1(d) fractional process is defined as 

(1.3) (l-B) d (Y t -Y Q ) = u t l(t > 1). 

where Yq is a random variable whose distribution is independent of t. There has been 



a recent surge of interest in Type II processes [25l . l28l | and it arises naturally when 
the processes start at agiven time point. The framework (|1.1[) includes a very wide 
class of processes 2(| 281 33, 34, 37 1. It includes linear processes u t — J27Lo ^j £t -i 



as a special case. It also includes a large class of nonlinear time series models, such 
as bilinear models, threshold models and GARCH type models 0, [!H . Recently, 
fractionally integrated autoregressive and moving average models (FARIMA) with 
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GARCH innovations have attracted much attention in financial time series modeling 
(see 0). In financial time series analysis, conditional heteroscedasticity and long 
memory are commonly seen UllliJ. The FARIMA-GARCH model naturally fits 
into our framework. 

Most of the results in the literature assume {ut} to be either iid or linear pro- 
cesses. Recently, Wu and Min 4l| established an invariance principle under (|1.2|) 
when d £ [0, 1/2). The literature seems more concentrated on the case d £ (0, 1/2). 
Part of the reason is that this case corresponds to long memory and it appears in 
various areas such as finance, hydrology and telecommunication. When d £ (1/2, 1), 
the process is non-stationary and it can be defined as 2 s =i or ^s; where 

X s and Y s are Type I and Type II l(d — 1) processes, respectively. Empirical ev- 
idence of d £ (1/2,1) has been found by Byers et al. [4[ in poll data modeling 
and Kim [l6| in macroeconomic time series. Therefore the study of partial sums 
of 1(d), d £ (—1/2,0) is also of interest since it naturally leads to 1(d) processes, 
d £ (1/2, 1). In fact, our results can be easily extended to the process with fractional 
index p + d, p £ N, d £ (-1/2, 0) U (0, 1/2) [cf. Corollary [HQ. 

The study of the invariance principle has a long history. Here we only mention 
some representatives: Davydov Mcleich [23|], Gorodetskii 11 1, Hall and Heyde 
[13], Davidson and De Jong [f|, De Jong and Davidson [3] and the references cited 
therein. Most of them deal with Type I processes. Recent developments for Type 
II processes can be found in 1^, 221. l36| among others. 

The paper is structured as follows. Section 2 presents invariance principles for 
both types of processes. Section 3 considers limit distributions of tests of long 
memory under mild moment conditions. Technical details are given in the appendix. 



2. Main Results 

We first define two types of fractional Brownian motions. For Type I fractional 
Brownian motion, let d £ (—1/2, 1/2) and 

1 r°° 

Md{t) = W) J-J {{t s)+}d w*)' 1 e R ' 

where (t)+ = max(i, 0), B(s) is a standard Brownian motion and 



1 



1/2 



Type II fractional Brownian motion {Wd(t), t > 0}, d > —1/2, is defined as 
W d (0) = 0, W d (t) = (2d + l) 1 / 2 f (t - s) d dM(s). 



The main difference of Md(t) and Wd(t) lies in the prehistoric treatment. See [22j for 
a detailed discussion of the difference between them. Here we are interested in the 
weak convergence of the partial sums T m = %-i and = YllLi Let T>[0, 1] 

be the space of functions on [0, 1] which are right continuous and have left-hand 
limits, endowed with the Skorohod topology 0]. Denote weak convergence by "=*>". 

For a random variable X, write X £ C p (p > 0) if \\X\\ p := [E(|X|p)] 1 /p < oo 
and || ■ || = || • j| 2 . Let T t — (. . . , e t _i, e t ) be the shift process. Define the projections 
V k by V k X = E(X|^ fe ) - E(X|^ fc _i), X £ C 1 . For two sequences (a n ), (&„), 
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denote by a n ~ b n if a n /b n — * 1 as n — > oo. The symbols "— and "— »p" 
stand for convergence in distribution and in probability, respectively. The symbols 
Op(l) and op(l) signify being bounded in probability and convergence to zero in 
probability. Let N{^i,a 2 ) be a normal distribution with mean /i and variance a 2 . 
Hereafter we assume without loss of generality that E(ut) = 0, fi = and Yq = 0. 
Let {e' k , k £ Z} be an iid copy of {st, k £ Z} and J 7 ^ = (JF-x, e' , E\, . . . , £/-). 

Theorems 12.11 and 12.21 concern Type I and II processes respectively. Using the 
continuous mapping theorem, Theorems 12 . 1 1 and 1 2 . 21 imply Corollarv l2. II which deals 
with general fractional processes with higher orders. For d S (—1/2, 0), an undesir- 
able feature of our results is that the moment condition depends on d. However, this 
seems to be necessary; see Remark 14. II Similar conditions were imposed in 130, 36]. 
Theorem 12. 21 ext ends early results by Akonom and Gourieroux [l[, Tanaka 1311 and 
Wang et al. [36l|. who assumed u t to be either iid or linear processes. See |l5l. I22]] 
for a multivariate extension. 

Theorem 2.1. Let u t € C q , where q > 2/(2d+ 1) if d £ (-1/2,0) and q = 2 if 
d € (0, 1/2). Assume 

OO 

(2.1) ^2\\V u k \\ q < (x. 

Then Q := £^ V 3 u k S and, if ||Co|| > 0, 

( 2 - 2 ) JlTTTJ «MM*) ^ V[0, 1], where Kl (d) = ^jf^y- 

Remark 2.1. Note that II Co II 2 = 27r/ u (0), where /«(•) is the spectral density 
function of {«*}; see Wu [39|, |41( for the details. 

Theorem 2.2. Under the conditions of Theorem \2.1l for Type II processes, we 
have 

(2.3) ^gJ_ K2 (d)W d (t) m V[0, 1], where n 2 {d) = 

By the continuous mapping theorem and the standard argument in j3(| , we have 
the following corollary. 

Corollary 2.1. Letut satisfy conditions in Theorem \2.1[ let d £ (0, 1/2)U(— 1/2, 0) 
and p £ N. [a] Define the process X t by (1 — B) p+d X t — u t . Then 

(i) n-^" 1 / 2 )^ ^ Kl (d)R d , p (t) mX>[0,l]; 

(ii) n-( rf +P+V2) £gJ ^ Kl ( d )B d , p+1 (*) in 2>[0, 1]; 
(hi) n- 2 < d +f) Eg X| =► K 2 (d) J^B^s)] 2 ^ zrc D[0, 1]. 
flere B^p^) is defined as 

n M-J BdW ' p = 1 ' 

' P I Jo Jo'*" • • • Jo 2 Bd(*0Ai*2 • • • <ttp-i, P > 2. 
[b] Define the process Y t by (1 - 5)P+ d f t = u t l(< > 1). Then similarly 
(i) n-( d +f-V2)y LntJ ^KaCdJWk+p-iCt) m£>[0,l]; 
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(ii) „-(<HiH-i/2) £L*J y ) K2 (d)W d+p (t) m T>[0, 1]; 

(iii) n- 2 < d +f) Eg ^ 2 «l(d) fo [W d+P -i( S )} 2 ds m V[0, 1]. 

We now discuss condition (|2.ip . Let gk(^Fo) = ^(uk\^o) and £ g (&0 = II <fa (■?-<-)) — 
( J?-"q ) 1 1 <j - Then S q (k) measures the contribution of £o m predicting u^. In [38( it is 
called the predictive dependence measure. Since IIPnUfrHr) < <5<j(fc) < SUPo^/cHg [38j |. 
(12. ip is equivalent to the g-stability condition [38] EfcLo ^(^) < 00 > which suggests 
short-range dependence in that the cumulative contribution of Eq in predicting 
future values of Uk is finite. For a variety of nonlinear time series, S q (k) = 0(p k ) 
for some a € (0, 1). The latter is equivalent to the geometric moment contraction 
(GMC) [SlU. Shao and Wu [H verified GMC for GARCH(r, s) model and its 
asymmetric variants and showed that the GMC property is preserved under an 
ARMA filter. In the special case Ut = X>fc=o bk£t-k, (EHJ holds if J2T=o ^ 00 
and £\ S £ 9 . 



3. Applications 

There has been much work on the test of long memory under the short memory 
null hypothesis, i.e. 1(0) versus 1(d), d £ (0,1/2). For example, Lo [2(| introduced 
modified R/S test statistics, which admits the following form: 

if fe - k - \ 

Qn = \ max y^(Xj - X n ) - min ~ X n) > , 

™ { - - 3 = 1 - - 3=1 ) 

where X n = n _1 X)j=i Xj is the sample mean and w n j is the long run variance 
estimator of X t . Following Lo [20] ]. 

(3-i) <i = - - ^«) 2 + 2 E 1 - 7TT H' 

3=1 3=1 V J 

where jj = - — A„)(A i+:) — A„), < j < n. The form (|3.ip is equivalent 

to the nonparametric spectral density estimator of {X t } evaluated at zero frequency 
with Bartlett window (up to a constant factor). Here the bandwidth satisfies 

(3.2) / = l(n) — > oo and l/n — > 0, as n — > oo. 



Lee and Schmidt applied [18( the KPSS test [Tifl for 1(0) versus 1(d), d e (-1/2, 0)U 
(0, 1/2). The test statistics has the form: 




with w 2 j given by (|3. If) . Lee and Schmidt showed that the test is consistent against 
fractional alternatives and derived its asymptotic distribution under the assump- 
tion that Ut are iid normal random variables. Giraitis et al. investigated fiol ] the 
theoretical performance of various forms of nonparametric tests under both short 
memory hypotheses and long memory alternatives. In a quite general setting, we 
obtain asymptotic distributions of R/S and KPSS test statistics under fractional 
alternatives. 
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Theorem 3.1. Suppose that X t is generated from (|1.2[) and ut satisfies (|2.ip with 
some q > max(2, 2/ (2d + 1)). Assume (|3.2[) . Then 

(3.3) r M <« ->p 

Consequently, we have 

(3.4) -i> ^ »<*(*) - oil^w. 

where M ( i(t) is the fractional Brownian bridge, i.e. Md(t) = Md(t) — tM<j(l), and 

(3.5) — Kn ^ D / (B d (t)fdt. 

n Jo 

Remark 3.1. For d € (0,1/2), Giraitis et al. obtained [13] (|3.4[) under the joint 
cumulant summability condition 

n 

(3.6) sup \cum(X ,X h ,X r ,X s )\=O(n 2d ). 



For linear processes, (|3 .6[) can be verified. But for nonlinear fractional processes 
(|1.2|) . it seems hard to directly verify (13. 6p . In contrast, we only need to impose a 
q-th (q > 2) moment condition when d € (0, 1/2). Our dependence condition ()2.1II 
can be easily verified for various nonlinear time series models 2t| 41 1 . 



4. Appendix 

Lemma 4.1. Let ai = i~^l(i), i > 1, where £ is a slowly varying function and 
f3 > 1/2; ^ <j > (3/2 - /3)" 1 if 1 < /3 < 3/2 and q = 2 if 1/2 < (3 < I; 
let u n = A(l - /3)n 3 / 2 "^(n)/(l - /?) and a n = (3 - 2/?)- 1 /2„3/2-^ )/(1 _ ^ 
issume ezt/ier (1°) 1< < 3/2, J2Zo a i = or ( 2 °) 1/2 < /3 < 1. Let 

(4.1) % = G(..., £j _ ll £ j ),i6Z, 

&e a martingale difference sequence with respect to o~(. . . , £j_i, £j). Assume rjj G £ 9 . 

Let = *7 = E<=o "Wj-i' $ = EJ=i S i = Ej=i 57- r/lerl we 

Ziawe [a] cr^S^ =>■ IMIB3/2-/3M 2?[0, 1] and [b] ^T^fntJ =^ II ^70 1 1 W' 3/2 _ jS (t) 
mP[0,l], 

Proof of Lemma \4.1\ [a] Consider (1°) first. For the finite dimensional convergence, 
we shall apply the Cramer-Wold device. Fix < t\ < t% < 1 and let mi = \_nti\ 
and m,2 = [ufo} ■ Let Ai = Ej'=o a i if * > and Ai = if i < 0. For A, /i € R let 

A(A TOl +2 — A;_to 2 ) + M(^2 — Ai- m ,) 
°n,l = " 

*l = [\ 2 t\~ 2fi + ft\-^ + + - (t 2 - h )^)]. 

Then (XS mi + ^S m2 )/<7 n — YaZo c n,iVm 2 -i has martingale difference summands 
and we can apply the martingale central limit theorem. By Karamata's Theorem, 
A n = — Y^jLn+i a j ~ n 1 '! 3 l(n) / ([3 — 1). Elementary calculations show that 

00 

(4.2) c 2 n l — > and sup |c ri! ;| — * as n — > 00. 
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Let Vi — E(77^ l2 _ i |J r „ l2 _;_i). By the argument in the proof of Theorem 1 in [13j ]. 
(14. 2p implies that Y^uLq c n ~ * a \ii m For completeness we prove it here. Let 
uj > be fixed, V? = Vjly,'^, and V{' = V l - V{ . By fO]) . 



lim sup 



oo 
i=0 



< limsup V c^c 2 ^, Icov^V^,)! = 



i,2'=o 



since lim^oo cov(U ', V fe ') = 0. Therefore, using Vi = V{ + V/', again by (|4~2)) . 



lim sup E 



(Vi - EVi) 



< lim sup E 

n — >oo 

< 2 lim sup 



XX,(vr-EV7) 



E 

Z=0 



as w 



CO. 



Under flU}, for any 5 > 0, E^Ell^; 7 / 



C "ri,Z'/m 2 -il- L |c„,i?J m2 _i|><5 



} -> 0. So the finite 



dimensional convergence holds. By Proposition 4 of Dedecker and Doukhan 



\S n f g < 2q\\ m \\ 2 q J2( A i 



A j - n ? = 0{o* n ). 



By Theorem 2.1 of Taqqu [32j, the tightness follows. (2°) Note that ~ ||??o|| 'n) 
the conclusion similarly follows. 

[b] The finite dimensional convergence follows in the same manner as [a] . For the 
tightness, let 1 < mi < m 2 < n, by Proposition 4 in [8(, 



m 2 — 1 

go ||2 ^ o„ll^_ 1 1 2 



mi "q 



< 2q\\T t0 \ 



1 Z-^i 

3=0 



(A 3 



A ~\ 2 
rni) ) 



~ 2 ) 

rri2—mi / 



With the above inequality, using the same argument as in Theorem 2.1 of Taqqu 
[32^ . we have for any < ti < t < t% < 1, there exists a generic constant C 
(independent of n,t\,t and t 2 ), such that for (3 £ (1/2, 1), 



E(|5 



\nt\ 



S\nt 1 \ \\&\nt 2 \ 



Sl ntl \)<Cal(t 2 - tl ) 3 -^ 



□ 



and for /3 <E (1,3/2), 

E|Sf ntJ - Sf„ tlJ V' 2 \S[ nt2l - Sf ntJ |«/ 2 < C~al(t 2 - tl )W-P\ 

Thus the tightness follows from Theorem 15.6 in Q. 

Remark 4.1. Under (1°) of Lemma I4.1[ the moment condition rjj 6 £ 9 , q > 
(3/2 — /3) _1 , is optimal, and it can not be reduced to rjj £ C qo , qo — (3/2 — 
Consider the case in which rji are iid symmetric random variables and P(|ryo| 90 > 
5) ~ .9~ 1 (l°gff) -2 as 5 — > co. Then rjj £ C qo . Let i(n) = 1/logn, n > 3. 



Elementary calculations show that a n 1 maxi<j<„ |^-| 



Y7 = + r]j — ijj^i and S'j' = X^- 1 Then the coefficients a' of Y/ also 



co in probability. Let 
4 of *i 



satisfy the conditions in Lemma 14.11 The two processes c T n 1 S^ nt ^ and a n S', nt <, 
< t < 1, cannot both converge weakly to fractional Brownian motions. If so, since 
maxj<„ \r]j - r/ | < maxj<„ \Sj\ + maxj<„ \S'j\, we have max.,<n \r]j\ = Op(a n ), 
contradicting er" 1 maxi<j< n | ^7 ^- 1 — > co in probability. Similar examples are given in 



41. l: 
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Proof of Theorem\2J± Let aj = T(j + d)/{T(d)T(j + 1)}, j > 0, and A k = £*L <h 
if k > and if k < 0. Note that [3 = 1 - d. Then X t = J2T=o a i u t~j- B V 

» = TZjPjUi e £«. Let M n = ELi Ci, ^ = E"=i ^ ^ = TZo^Q-i, 

U n = J2i=i M » and #n = T n - Sn- By Theorem 1 in ||C/„ - M n \\ q = o(y/n). By 
Karamata's theorem and summation by parts, we have 



I Rm 1 1 q ^ 



3 m 



^ ^ (^-z ^-i—m}i^m—i Ctn—i) 
oo 

3m + l 

= E - Ai- m ) - (Ai-i - Ai-x- m )\o{Vi) 

oo 

+ E \{A i -Ai-m)-(A i - 1 -A i -i- m )\o(V%) = o(ir m ). 



3l)7 



z=3m+l 

By Proposition 1 in [39j |. 



max |i?„ 

m<2 t! 



< ^2^)^11^,11, = ^ 2< fe - I ')/« ( ( T 2 .) - o{a. 



2 k , 



9 r=0 



r=0 



since q > 2/ (2d + 1). So the limit of {IjntJ /o" n , < t < 1}, if exists, is equal to the 
limit of {Sy nt j /a n , < t < 1}. By Lemma BTT1 the latter has a weak limit. So (|2.2[) 
follows. □ 



Proof o/ Theorem GDI As in the proof of Theorem [2TJ let = £*. =1 Y j and 
= T° n — S^. By Karamata's theorem, 

Again by the maximal inequality (Proposition 1 in [39j]), 



max 

m<2 fc 



k 

^E 

9 r=0 
fe 



E II ~ ^ 



0-1) II 9 



which proves the theorem in view of Lemma 14.11 



□ 



Proof of Theorem \3.1\ If (|3.3|) holds, by the continuous mapping theorem, Theorem 
2.11 entails (|3.4p and (|3.5p . In the sequel we shall prove (|3.3|) . Note that 



j=l i=l V 7 i=l 



3=1 



i=l 



=:/i 
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Since \X n \ = P {n d - 1 ' 2 ), r 2d (X 2 + \hn\) = P P ((I/n) 1 - M )_ = o P (l). Thus it 
suffices to show that l~ 2d h n n\{d). Let V = Y^l=i x t, V 3 = J2i= n -j+l X ^ 
1 < j < I, then a straightforward calculation shows that I\ n = J\ n + </2n, where 

2 



Jln - (TH> E E ^ 

v ; i=i+l \j = i-i 



i=i 



Corollary ED implies that £*- =1 V? = P (7 2d + 2 ). Since £^- =1 V/ 2 has the same 
distribution as £^. =1 V?, we have J 2n = P {l 2d+2 /{In)) = o P (Z 2d ). 

It remains to show l~ 2d J\ n - p n\{d). Let (j = e = HILi C*i 

J7„ = E"=i u i arL< i r « = su Pj>Ti ll^j — -^jll/v^?- Then r„ — > and it is non- 
increasing. Let L = [minjvw, K'Vz) 1 ^ -1-2 ^}]- Then Z = o(L) and L = o{n). 
Let 



i=0 i=0 

and % = Ei =i _i Then J ln = ^ £" =i+1 ^ Since l/L - 0, 



ll^v-^vl 



(4.3) 



< 



=L+1 
00 



1/2 



J2\\Tou t \\ =o{ m ). 



_i=L+l 

By the definition of L 7 using summation by parts, we have 

L 

\\W jt i - Q h i\\ <J2\( A i~ A i-l-i) ~ ( A i-i ~ Ai-i-^nVi 
- r VT E 2 i a »lv^ + y^^\ai\nVi = o((ti). 



i=i 



Now we shall show 
(4.5) E 



Y^iQi 1 - mh)} 

i=i 



o(raof). 



Since r m := E|E(C£|jF_ ro ) - E(C 2 )| -» as m -> 00, 

(4.6) E\E(Q 2 2Lk,i\^Lk-2L) - V(QlLkj)\ < E( A * ~ A i-l-l?r2L-i = o(ct 2 ). 



i=0 



Let D k = Q 2 2Lk j-~E(Q 2 2Lk,i\F2Lk~2L), k=l,...,b= [n/(2L)\ . Set C q = l%q^ 2 {q- 
l) -1 / 2 and q' = min(g, 4). By Burkholder's inequality, 



(4.7) 



fe=l 



2U.lL 



9/2 



= & 2 /«'0(af) = (6af). 
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Thus g3]) follows from gU) and g7]). By (TO]), g3) and (T4~5j) . 



E 



£{S£|-15(Q»,)} 



i=i 



o(naf) 



which completes the proof since E(Q^ ; ) ~ of ||Co| 



□ 
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